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1.  Introduction 

Traffic  analysis  in  anonymizing  network  configurations  can  be  used  to  open  a  covert 
communication  channel.  Recently,  Moskowitz  et  al.  [2]  have  developed  a  mathematical  model 
(whose  salient  feature  is  given  by  equation  (1.1)  below)  that  describes  the  situation  of  oneway 
messages  passing  from  private  Enclavei  to  private  Enclave2  in  which  each  communication 
is  encrypted  and  passes  through  exit  and  entry  mix  firewalls.  Furthermore,  there  are  n  + 
1  senders  in  Enclavei,  and  one  of  them  called  Alice  is  malicious.  The  other  n  clueless 
transmitters  are  benign.  Every  sender  may  send  at  most  one  message  per  unit  time  t.  to 
Enclave2.  All  messages  from  Enclavei  to  Enclave2  pass  through  a  public  line  that  is  subject 
to  eavesdropping  by  an  eavesdropper  called  Eve  who  knows  the  value  of  n.  The  only  action 
Eve  can  take  is  to  count  the  number  of  messages  per  t,  going  from  Enclavei  to  Enclave2. 
The  n  clueless  transmitters  all  send  their  messages  per  t  as  independently  and  identically 
distributed  Bernoulli  random  variables  with  parameter  q.  Alice  acts  independently  (through 
ignorance  of  the  n  clueless  senders)  when  deciding  to  send  a  message.  Thus,  Alice  by  sending 
or  not  sending  a  message  affects  the  number  of  messages  that  Eve  counts.  This  in  brief  is 
the  covert  channel. 

A  normalizing  noise  term  S(n )  is  defined  corresponding  to  the  degree  of  anonymity 
afforded  by  the  n  clueless  senders  transmitting  as  fair  coins  (q  =  1/2)  which  is  the  situation 
when  maximal  anonymity  occurs.  For  n  =  1,  2,  3, . . .  S(n)  is  shown  in  [2]  to  be  given  by 


S{n) 


n  +  1 
k 


f  n  +  1 

{  k 


(1.1) 


and  by  employing  Shannon’s  information  theory  the  capacity  is  given  by  1  —  S(n)/  In  2.  More¬ 
over,  an  important  property  of  this  model  is  that  the  capacity  should  decrease  monotonically 
to  zero  with  increasing  n. 

For  brevity  in  the  sequel  we  define  T(n )  =  2 nS(n).  The  expression  for  T(n )  is  of  interest 
in  its  own  right,  since  it  is  the  difference  of  two  divergent  sums  that  contain  products  of 
binomial  coefficients  and  their  logarithms.  Moreover,  these  types  of  sums  appear  not  to  be 
readily  found  in  the  mathematical  literature. 
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In  the  present  investigation  we  shall  obtain  in  section  2  a  simpler  algebraic  representa- 

n  ( 


tion  for  T(n )  which  contains  the  sum  Y 

k= o 


n 


k 


In  (A;  +  1)  that  is  similar,  for  example,  to  a 


particular  sum  involved  in  a  representation  for  In,  (x  +  1)  deduced  by  Stirling  for  x  >  —l 
(see  [1,  equation  (5.47)]).  We  shall  also  derive  two  integral  representations  and  two  repre¬ 
sentations  involving  integrals  for  S(n).  Then  in  section  3  we  give  a  detailed  proof  that  S(n) 
is  monotonically  increasing  with  increasing  n.  This  property  of  S(n)  alluded  to  above  was 
verified  numerically  in  [2]  for  n  <  7750.  Finally,  in  section  4,  we  show  that  S(n)  — t  In  2  as 
n  — t  oo.  We  record  some  consequences  of  the  latter  as  well. 


2.  Reduction  of  S(n)  to  a  simpler  sum 

Recall  that  T(n)  =  2 nS(n)  where  S(n )  is  given  by  equation  (1.1).  We  shall  show  below 
that 

.  / 

n 


T{n )  =  2"  ln(n  +  1)  -  El  '  IM*  +  i) 

k=o  k 


and  so  S(n )  may  be  written  elegantly  as 


(2.1) 


1  n 

5(n)  =  E 


n\  fn  + 1 

In 


k= o  \  k 


k  +  1 


(2.2) 


To  prove  the  latter  we  define 


a{n)  =  Y, 
k= 0 


M 

In 

(n) 

Kkj 

where  the  binomial  coefficient 
k  <  0.  Thus 


n 


=  n\/k\(n  —  k)\  which  we  agree  vanishes  if  k  >  n  or  if 


n 

a(n )  =  In  n\  Y 
k= o 


(n\ 

n 

-E 

fn) 

n 

In  A:!  -  Y 

(  n  \ 

kk) 

k=0 

\k) 

k= 0 

In  (n-k)\.  (2.3) 
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The  first  sum  equals  2n.  By  noting  that 


n 

n  —  k 


and  reversing  the  order  of  summation  (i.e.  by  letting  k  e- )►  n  —  k )  in  the  third  sui 
that  the  second  and  third  sums  in  equation  (2.3)  are  equal  so  that 


fl 

a( n)  =  2n  In  n!  —  2  +)  I  |lnA4 
k= o  \  k 


and  so 


a  [n 


+  1)  =  2,,+1ln(n  + 1)!  -2^ 


n+l  (  n+  1  \ 


k=0 


In  Ad  . 


V  k  ! 


From  equation  (1.1)  and  the  definitions  of  T(n)  and  a(n )  it  is  evident  that 


T(n)  =  -a(n  +  1)  —  a(n) 

Z. 


and  so  by  using  equations  (2.5)  we  have 


n+l 


T(n)  =  2nln(n  +  1)  +  ^ 

k= 0 


H 
\ k } 


n  +  l 
A: 


In  A:! 


Now  observing  that 


equation  (2.6)  gives 


(  n  +  l 

(n) 

(  a  \ 

= 

+ 

{  k  ) 

[  kJ 

{k~  + 

n 


n+l 

T(n )  =  2”  ln(n  +  1)  +  ^  I  I  In  A:!  —  ^  I  In  A:! 

k= o  \k  k=i  k  —  1 


Finally,  since 


n+l 

E 

f  n  \ 

n 

In  A:!  =  ^2 

\k-l  ) 

k= 0 

l  k  ) 

ln(Jfe  +  l)! 


we  obtain  equation  (2.1). 


(2.4) 

,  we  see 

(2.5a) 

(2.5b) 


(2.6) 


(2.7) 
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Thus  also 


1  n 

S(n)  =  ln(n  +  1)  -  —  £ 

~  k=  0 


n 


A: 


ln(Jfe  +  l) 


(2.8) 


which  shows  that  — S(n )  is  the  difference  of  a  divergent  weighted  sum  of  logarithms  In  (A: 

\ 


n 


=  1)  and  the  montonically  increasing  logarithm  ln(n  +  1).  This 


1)  (since  V'  2 

to  \  k 

observation  brings  to  mind  and  is  analogous  to  one  of  the  many  formulations  for  Euler’s 


J 


constant  7  (cf.  e.g.  [1,  equat  ion  (6.65)])  which  is  the  limiting  value  as  n  — >■  00  of  the  much 

n 

simpler  difference  of  the  divergent  harmonic  series  ^  1/A:  and  ln(n  +  1).  (However,  we  show 

k= 1 

in  section  4  that  S(n)  — >■  In  2  as  n  — >■  00.)  We  have  already  noted  that  series  of  the  type 
appearing  in  equation  (2.1)  appear  in  the  literature  in  other  contexts. 

We  conclude  this  section  by  deriving  four  integral  representations  for  S(n).  We  start 
with  (see  [3,  section  2.6.17.,  equation  (1)]) 

dx 


In 


(2,9) 


In  a: 

where  n  >  —1  and  A:  >  —1.  Multiplying  both  sides  of  equation  (2.9)  by  the  binomial 
n 
A: 


coefficient 


and  summing  over  the  index  A:  gives 


E 

k= 0 


/ 


n 


A: 


In 


(iTT 


dx 

ln.x 


Dividing  each  side  of  the  latter  equation  by  2"  and  noting  equation  (2.2)  we  deduce  for 
n  =  1,  2,  3  . . . 


S{n)  =  f 

Jo  L 


xn  - 


1  +  X 


dx 
J  ln.T 


Now  making  the  transformation  x  =  e  *  in  the  latter  integral  yields 

J\n 


sin )  =  J 

Jo 


0-(n+l)t 


1  +  e 


-  1 


dt 

t 


(2.10a) 


(2.10b) 


However,  letting  n  =  0  in  equation  (2.9)  we  may  start  with 

dx 


ln(A:  +  1)  =  [\xk  -  1) 
Jo 


In  a: 
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n 


Multiplying  the  latter  equation  by  [  ]  and  summing  over  k  now  gives 

A: 


JL  (  n  \  ri 

E  ln(A’  +  1)  =  /  [(1  +  x)n  —  2n] 

k= o  \  k  Jo 


V  *  / 

which  upon  dividing  by  2"  and  noting  equation  (2.8)  yields 


dx 

In  a’ 


S(n )  =  ln(n  +  1)  +  / 


1  r  /l  +  a; 


dx 

1  n  a: 


Upon  making  the  transformation  x  =  e  in  the  integral  this  result  can  also  be  written  as 


S(n )  =  ln(n  +  1) 


r  oo 

ifi+e-ty  1 

/ 

-  -  1 

Jo 

to 

o -t 


-clt  . 


3.  Monotonicity  and  boundedness  of  S(n ) 

We  now  prove  that  S(n )  is  increasing  with  increasing  n  >  1,  i.e.  S'(n  +  1)  >  5(n)  for 
n  =  1,  2,  3, . . .. 

By  employing  ecjuation  (2.8)  we  have 


’li,1  (  n  +  1  \ 

ln(A:  +  1)  —  E  ln(A:  +  1)  . 

k= o  l  k  I 

(3.1a) 

Now  utilizing  equation  (2.7) 


2n+1[S(n  +  1)  —  S(n)]  =  2n+1  In  ^ 


n+ 1 

E 

k= 0 


n  +  1 
k 


ln(*  +  l)  =  £ 

k=0 


n 

k 


n 


n+ 1 

K*  +  D  +  E 

fc=i  \  k  —  1 


ln(Jfc  +  l)  (3.1b) 


and  noting  that 


n+l 

E 

fc=l 


n 

k  -  1 


ln(A:  +  1)  =  E 
0 


ln(A:  +  2) 


(3.1c) 
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we  have  from  equations  (3.1) 


2»ns(„  +  1)  -  S(„)]  =  in  (2±|)  -  t  [  l  J  m  (li|)  •  (3.2) 

There  are  two  cases  to  consider:  n  odd  and  n  even.  Accordingly,  letting  n  i— )►  2 n  in 
equation  (3.2)  gives  for  n  =  1,  2,  3, . . . 


2-[S,2n  +  1)  -  S(2„)]  =  2-  In  (|±|)  -  g  *  In 


(  2n  \  I  2 n  \ 

Since  —  where  equality  holds  if  and  only  if  k  =  n  we  have 

\  kj  In, 


22n+1[S(2n  +  1)  -  S(2n)]  >  22n+1  In 


2  n  +  2 
2n  +  1 


2 n  \  Ai,  /A:  +  2 

£ln  ( 

n  A:=0  \ft'  ^  1 


The  sum  of  logarithms  in  the  latter  inequality  is  equal  to  ln(1^)  and  it  is  easy  to  show  that 


2 n  |  _  2g/  ,  (f  +  n) 
n  I  aA7  ,  (1  +  n)  ' 


Thus  defining  for  n  =  1,  2,  3, . . . 


m  =  4i±A 

20F  ,  (1  +  n) 


we  can  write  inequality  (3.3)  as 


S(2n  +  1)  —  S(2n)  >  In  ~  fi{n)  In  ( 


'ii  +  l 


Now  1)  =  1/4  and  it  is  easy  to  show  that  (3(n  +  1)  <  /3(n).  Thus  equation  (3.5)  gives 
S(2n+1)-S(2„)  >  In  (|i±|)  -  I  In 


=  In 


n  +  1  \  /  n 
n  +  1/2 J  V  n  +  1 
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and  so 

n(n  +  l)2 3 
(n  +  1  /  2 ) 4  _ 

It  is  readily  shown  for  n  >  1  that  n(n  +  l)3/(n  +  1  / 2 ) 4  >  1  and  so  S(2n  +  1)  >  S(2n). 
Next,  letting  n  e- )•  2 n  +  1  in  equation  (3.2)  gives  for  n  =  0, 1,  2, . . . 


S(2n  +  1)  —  S(2n)  >  -  In 


)  (— 2 


[5(2n  +  2)-S(2n  +  l)]  =  2«In(^±|)-|1  211  +  1 


\ 


J 


In 


'A: +  2' 
A:  +  1 


Since 


V 


2  n  +  1 
A: 


< 


2n  +  1 


V 


n 


2  n  +  1 
n  +  1 


where  equality  holds  if  and  only  if  either 


k  =  n  or  k  =  n  +  1  we  have 


22n+2[S(2n  +  2)  -  S{2n  +  1)]  >  22n+2  In 


2  71  +  3 
2n  +  2 


+ 1  ,  (3_6) 


n  /  k=o 


A:  +  1 


where  equality  holds  if  and  only  if  n  =  0.  The  sum  of  logarithms  in  the  latter  inequality  is 
equal  to  ln(|^±|)  and  it  is  easy  to  show  that 


(  2  n  +  1  ^ 

V  n  ) 


22n+1  ,  (|  +  n) 

■.  (-  I  a) 


so  that  noting  equation  (3.4) 


'  2  n  +  1  ^ 

V  n  ) 


22n+2f3{n  +  1)  . 


Thus  we  obtain  from  equation  (3.6) 


S{2n  +  2)  —  S(2n  +  1)  >  In  (|(i|)  -  /}(„  +  1)  In  (|i±|) 


where  n  =  0,l,2,....  Since  0(1)  =  1/4  and  0(n  +  1)  decreases  with  increasing  n 


S(2n  +  2)  —  S(2n  +  1)  >  In 


/2  n  +  3\ 
V  2n  +  1  / 


1  I"  (2n  +  l)(2n  +  3)3 

4  11  [  (2  n  +  2  Y 
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Finally,  setting  m  =  2n  +  1  is  is  easy  to  show  that  m(m  +  2 )3/(m  +  l)4  >  1  for  m  >  1  and 
so  S(2n  +  2)  >  S(2n  +  1)  which  completes  the  proof  of  the  monotonicity  of  S(n). 

We  conclude  this  section  by  showing  for  n  >  1  that 

S(n)  <  2(1  —  2_n_1)  <  2  .  (3.7) 

Assuming  the  latter,  since  S(n )  is  monotonically  increasing  and  bounded  we  may  define 


//  =  lim  S(n)  , 


where  from  inequalities  (3.7)  we  must  have  0  <  //  <  2. 
To  show  inequalities  (3.7),  upon  observing  that 

//  +•  1  \  n  I  1 


In 


we  have  from  equation  (2.2) 


k  +  1 )  <  A:  +  1 


c,  ,  n  +  1  " 

s(«)  <  —  E 

k= 0 


(A:  =  0,  l,...,n)  , 


n 


k 


k  +  1 


Since  (see  e.g.  [3,  section  4.2.2.,  equation  (42)]) 

1  1 


E 

k= 0 


/A 


V  k  ) 


k  +  1  n  +  1 


(2n+1  -  1)  , 


it  is  evident  that  S(n )  <2  —  2  n  and  we  are  done. 


(3.8) 


4.  The  limiting  value  of  S(n)  as  n  -+  oo 

From  equation  (2.2)  we  may  write 

/ 


S(n)  =  ~t 

~  A;=0 


In  (  1  — 


V 


n  —  A: 
n  +  1 


Letting  k  *-+  n  —  k  and  using  equation  (2.4)  in  this  result  then  yields 

A’  \ 


SM  =  -*± 

"  k= 0 


V  *  / 


In  1  — 


n  +  1 


(4.1) 
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Since  for  0  <  ,2  <  1 


oo  # 


ln(l-^)  =  -£ 

p=i  P 


(4,2) 


setting  z  =  k/(n  +  1)  we  have  from  equations  (4.1)  and  (4.2) 

k  V 


1  n 

S(n)  =  ^7  E 

“  k= 0 


/«\ 


V  k  ) 


OO  A 

y  - 

p^ip  \n+i. 


Formally  interchanging  the  order  of  summation  then  gives 


1  00  1  1 

s(»>  =  4e 


n 


2%=i  P  («  +  l)%=i  k 


kp  , 


(4.3) 


where  for  integers  p  >  0 

kp  =  2n_p 


n 


E 

k= i  \  A; 


n 

P 


n 


p- 1 

p!  +  2"  £ 

/,  _  i  \  k 


i  \  fc  k 

-5)  B-l)' 

-  7  I  Jo 


\ 


) 


ip  ,  (4.4) 


and  it  is  understood  that  the  latter  second  term  vanishes  when  p  =  1.  Equation  (4.4)  is 
derived  ab  initio  by  Schwatt  (cf.  [4,  p.  84,  equation  (34)])  where  here  a  misprint  is  now 
corrected. 


Since 


1  n\ 


\  p ) 


=  n!/p!(n  —  p)\  we  have  from  equations  (4.3)  and  (4.4) 


,  _  v-  <1/21!  J4(»)  .  ^  1  Qp-An) 


P  (n  +  l)P  p  (n  +  l)p  ’ 


where  we  have  defined 


Mp{n)  = 


n\ 


[n  —  p)\ 


and 


p- 1 

Qp- 1(»)  =  Y. 


(”) 

(  1  \k  Jl 

f  k  ' 

(~)  u-y 

\k) 

V  27  t=0 

l  f  J 

P  . 


(4,5) 


(4.6) 


(4.7) 


Observing  that  the  first  and  second  p-summations  in  equation  (4.5)  will  terminate  respec¬ 
tively  when  p  >  n  and  p  —  1  >  n,  this  result  can  only  be  valid  as  a  divergent  asymptotic 
expansion  for  S(n)  about  n  =  00. 
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However,  it  is  easily  seen  from  equation  (4.6)  that 


Mp(n )  =  n(n  —  1) . . .  (n  —  (p  —  1)) 


and  so  Mp(n )  is  a  monic  polynomial  in  n  of  degree  p.  Thus  for  each  p  >  0  it  is  evident  that 

(n  — >■  oo)  .  (4.8a) 


Mp{n)  =1+0/l 


n 


(n  +  l)P 

Moreover,  from  equation  (4.7)  it  is  also  easily  seen  that  Qp-i(n)  is  a  polynomial  in  n  of 
degree  p  —  1.  Let  cp-\  be  the  coefficient  of  np~l  in  Qp-i(n).  Then  also  from  equation  (4.7) 
we  have 


^  (p-D!  h,  1 


/ 


v 


p  —  1 
£ 


(V  _ 


Schwatt  [4,  p.  101,  equation  (196)]  has  shown  for  p  >  1  that 

\ 


p- 1 

El-1) 

£=0 


P-  1 

t 


£P  =  (-l)P-'-(p-l)p\ 


so  that 


Thus  we  have 


T \p 

cp- i  =  l  2  )  Pi'P-1) 


(n  — )■  oo) 


(4.8b) 


and  by  using  equations  (4.8)  we  have  from  equation  (4.5)  the  asymptotic  result 


S{n)  = 


1  +  0 


n 


(1/2  y 


p 


o 


/1\  00  /l\p 

(-)  E  (2)  (p  - x)  (n  ^ 00 )  •  (4-9) 


Recalling  ecjuation  (4.2)  the  first  sum  in  equation  (4.9)  equals  In  2  and  it  is  easily  shown 
that  the  second  sum  reduces  to  unity  so  that  we  can  now  write  equation  (4.9)  as 

S(n)  =  1+0  Q  In2  +  C>Q  (n  ->•  00)  . 

Finally,  since  we  have  already  shown  in  section  3  that  lim ^S(n)  exists  as  a  positive  number 
p  <  2,  it  is  evident  from  the  latter  result  that  //  =  In  2. 
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We  end  by  recording  two  interesting  corollaries  that  are  obtained  immediately  from  equa¬ 
tions  (2.10),  namely 


lim  / 

n-ooo  J o 


xn  - 


and 


lim 

n— s-oo 


-,—(n+l)x 


1  +  X 


1  +  ea 


dx 
In  a; 


=  In  2 


-  1 


dx 

—  =  In  2 

x 


5.  Conclusions 

We  have  discussed  how  an  important  application  in  anonymity  and  covert  channels  leads 
to  the  problem  of  deducing  properties  of  the  difference  of  sums  containing  products  of  bino¬ 
mial  coefficients  and  their  logarithms.  Intuitively,  the  capacity  of  the  covert  channel  should 
decrease  monotonicallv  to  zero  as  the  number  of  transmitters  increases,  and  the  analysis 
provided  herein  proves  this. 
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